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(54) Moving picture encoding apparatus and method 



(57) The present invention relates to a method and 
apparatus of digital compression encoding of image 
such as video signal and controlling the quantizing 
width when encoding and/or controlling the number of 
bits generated. 

The method for compressing and encoding a pic- 
ture is implemented in a moving picture encoding appa- 
ratus comprising a control unit (6) for adjusting the 
target number of bits depending on the result of dividing 



the error between the target number of bits correspond- 
ing to the target bit rate and the number of generated 
bits required for encoding image segment groups just 
before by a number of 2 or more, and controlling the 
quantizing parameter (q-scale) for encoding the image 
segment groups depending on the adjusted target 
number of bits. 
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Description 

Technical Field 

5 The present invention relates to a method and apparatus of digital compression encoding of image such as video 

signal, and wore particularly to an apparatus and method of controlling the quantizing width when encoding and/or con- 
trolling the number of bits generated. 

Background Art 

10 

Hitherto, as the transform format for compressing an image signal and converting into a digital code, an interna- 
tional standard format proposed in ISO/IEC 13818-2 (so-called MPEG2) has been known. A typical method of digital 
encoding of image signal conforming to this format is shown in Test Model 3 of ISO-IEC/JTC/SC29/WG1 1 No. 328. Rg. 
1 is a block diagram of a typical MPEG2 video encoding apparatus. This MPEG2 video encoding apparatus comprises 

75 a frame converter 1 01 for shuffling input video signals into encoding sequence, a block converter 1 02 for converting pic- 
ture data into encoding units called macro blocks, a subtractor 103 for determining the difference between an input 
macro block and a predicted value about its image data, a DCT (discrete cosine transform) 104, a quantizer 105, a var- 
iable length encoder 106, an inverse quantizer 107, an IDCT (inverse discrete cosine transform) 108, a motion compen- 
sation block 109, a mode discriminator 110, a motion detector 111, a quantizer control block 112, an encoder buffer 

20 1 13, and an adder 114. . . 

Prior to explanation of operation of thus constituted MPEG2 video encoding apparatus, the data structure of image 
for encoding is described by referring to Fig. 2. 

Each picture of image to be encoded is divided into macro blocks and encoded. The picture is an image of frame 
or field unit, and unless otherwise noted, in the following description, the frame is called a picture. This macro block is 

25 a data area of 1 6 x 1 6 pixels, and the luminance and color difference signals are respectively encoded in a block of 8 x 
8 each. 

One data unit called a slice is composed of plural macro blocks, and one picture is composed of plural slices. The 
picture consists of I picture for encoding within the picture. P picture for predicting from past picture in time, and B pic- 
ture for predicting from both past and future pictures in time. The picture configuration in Fig. 2 is a typical example, in 
30 which a P picture, three pictures ahead, is predicted by using a first I picture, and B pictures existing between them are 
predicted on both sides. Therefore, when encoding, it is necessary to encode the I picture in the first place, and P pic- 
ture, then B pictures, which requires to convert the arrangement of images in the original time direction. 

Furthermore, by plural pictures starting from I picture, a group of pictures (GOP) is composed, and one video 
sequence is composed of an arbitrary number of GOPs. Summing them up, the macro block is defined as an image 
35 segment, and the slice, picture, and GOP composed of plural macro blocks may be defined as image segment groups. 
Supposing the GOP to be an image segment group, for example, the picture which is a smaller image segment group 
may be defined as a sub-set of GOP or image segment group. 

On the basis of such data structure, the operation of the MPEG2 video encoding apparatus in Fig. 1 is described 
below. 

40 An input signal is fed into the frame converter 101, and the sequence of pictures of input image is converted. The 
output of the frame converter 101 is supplied into the block converter 102, and the block converter 102 divides the 
entered image into macro blocks of 16 x 16 pixels each, and supplies to the subtractor 103. In the subtractor 103, the 
predicted value obtained from the motion compensation block 109 is subtracted from the signal supplied from the block 
converter 102, and a predicted error is determined. The predicted error is transformed in the DCT 104 into each block 

45 of 8 x 8, and each transformed coefficient is quantized in the quantizer 105, and quantized data is created. The quan- 
tized data is encoded by variable length in the variable length encoder 106, and compressed encoded data is created. 
The compressed encoded data is, in order to be transmitted at a desired transmission rate, one stored in the encoder 
buffer 113, and is issued. 

On the other hand, the data quantized in the quantizer 105 is reproduced in the inverse quantizer 107 and IDCT 
so 1 08 in order to produce a predicted image. The reproduced image data is put into the motion compensation block 1 09, 
and a predicted value is calculated and supplied into the subtractor 1 03. The motion detector 1 1 1 calculates the motion 
vector in every macro block, and the motion vector is put into the motion compensation block 109. and is also supplied 
into the variable length encoder 106. The quantizer control block 1 12 compares the number of generated bits in the bit 
stream produced from the variable length encoder 106 and the target number of generated bits converted from the tar- 
55 get bit rate, and controls the quantizing width of the quantizer 1 05 so that encoding may be finally completed at the tar- 
get number of bits. 

Processing in the quantizer control block 1 1 2 is described below. First, suppose the target number of bits per GOP 
converted from the target bit rate to be G, the number of bits left over in this GOP in the process of encoding to be R 
the number of generated bits of the image of I, P, and B pictures encoded immediately before to be respectively SI. SP, 
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SB, and the average of quantizing parameters at this time to be respectively Ql, QP, QB. At this time, the difficulty in 
encoding of each picture XI, XP, XB is respectively defined as XI=SI x Ql , XP=SP x QP , XB=SB x QB , and the target 
number of bits for encoding each picture is calculated as follows concerning I, P and B pictures. 

Tl- ? (1) 

NP • XP NB • XB v 1 

XI • Kp + XI • Kb 

tp = 5 (2) 

Kp-NB-XB 

™ r+ XP • Kb 

TQ R (3) 

kid Kb • NP - XB 
NP + XB - Kp 

where Kp, Kb are constants, and NP, NB are the numbers of remaining P pictures and B pictures not encoded yet. The 
value of R is updated at R = R-S ( supposing the number of bits generated in the picture to be S, and is updated at 
R = R+G at the beginning of the GOP That is, the number of bits generated per GOP is determined, bits are assigned 
and encoded depending on the composition ratio of each picture, and the number of generated bits is determined in 
each picture, and the value is subtracted from R, and the target number of generated bits is corrected and assigned in 
each picture again, and the same procedure continues. Moreover, when the number of bits required for encoding one 
GOP is different from the target number of bits assigned in the GOP, either one is assigned in the target number of gen- 
erated bits in the next GOP 

The method of controlling the quantizing parameters from the target number of generated bits of each picture is 
described below. First, virtual buffers are assumed for I, P and B pictures, and supposing the target number of gener- 
ated bits in each macro block to be constant when encoding an i-th macro block, the data remainders of the virtual buff- 
ers dli, dPi, dBi are expressed as follows. 

dli=dlO+B M -Tlx(i-1)/MB_cnt (4) 

dPi=dP0+B M -TPx(i-1)/MB_cnt (5) 

dBi=dB0+B M -TBx(i-1 )/MB_cnt (6) 

where Bi is the number of generated bits in all preceding macro blocks including i, MB_cnt is the number of macro 
blocks contained in one picture, and dIO, dPO, dBO are initial values of buffer remainders at the beginning of each pic- 
ture. In these formulas, the second term of the right side refers to the number of bits required to encode up to the imme- 
diately preceding macro block, and the third term expresses the target number of bits required to encode up to the 
immediately preceding macro block, and therefore by calculating the difference of the second term and third term, the 
error between the number of bits actually required for encoding and the target number of bits is obtained. By adding this 
error to the initial value of the buffer remainder, the buffer remainder for encoding the i-th macro block is obtained. 

Using the buffer remainder calculated in the above formulas, the quantizing parameter Qi in the i-th macro block is 
obtained as follows. 

Qi=di x 7 1 ( 7 ) 

where r = 2 x (target bit rate) / (picture rate) . 

Summing up the operation, regarding a target bit rate, the target number of generated bits is set in picture unit, and 
the nurrber of generated bits is limited to the target number of bits in the GOP unit in which the picture is included. In 
each macro block, depending on the error between the actual number of generated bits and the target number of bits 
assumed that the number of generated bits to be constant, the quantizing parameter is controlled. As. a result, the 
image is encoded so that the code generation amount may be close to the target number of generated bits of each pic- 
ture. 

In such encoding method, however, the number of generated bits is set in the picture unit, and the quantizing 
parameter is controlled so that the number of generated bits may coincide with the target number of generated bits in 
the GOP unit in which the picture is included, and therefore when the picture changes suddenly and the number of bits 
required for encoding increases, it is controlled to increase the quantizing width so as to suppress to the target number 
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bits. As a result, the picture quality may deteriorate. 

Or, if the actual number erf generated bits increases extremely from the target number of generated bits in a certain 
GOR it is controlled so that the target number of generated bits in next GOP may absorb this error, and when the picture 
quality in that GOP may deteriorate. 

Yet, when relatively flat images are concentrated in a first half of a certain picture and complicated images are con- 
centrated in a second half, it is ideal to assign more bits in the second half. In the above method, however, the target 
number of bits is uniformly assigned in each macro bit, and the quantizing parameter is set depending on the error from 
the number of bits required actually in each macro block, and hence there was a possibility of assignment of more bits 
in the first half and occurrence of more bits than expected in the second half. To the contrary, if complicated images are 
concentrated in the first half, the number of bits generated in the first half is limited, and bits are not assigned ideally. 

To overcome such problems, it may be considered to encode once all images, determine the ideal bit distribution 
in all images, and encode again, but it is difficult to encode in real time. 

Object of the Invention 

It is hence an object of the invention to provide a moving picture encoding apparatus and method capable of dis- 
tributing bits appropriately depending on the difficulty in encoding moving pictures. 

It is other object of the invention to provide a moving picture encoding apparatus and method for setting an appro- 
priate quantizing width by distributing bits appropriately without once encoding all images. 

It is a different object of the invention to providea moving picture encoding apparatus and method for determining 
target bits to be generated so as to absorb the error between the target number of generated bits to be generated in 
one image segment composed of plural pictures such as GOP, and the number of actually generated bits, gradually 
over plural image segment groups. 

It is a further object of the invention to provide a moving picture encoding apparatus and method for controlling the 
target quantity of generated bits so that the target quantity of generated bits may not change abruptly in adjacent picture 
segment groups. 

It is a further different object of the invention to provide a moving picture encoding apparatus and method capable 
of controlling an optimum quantizing width on the basis of the target number of generated bits to be generated in one 
image segment group. 

Summary of the Invention 

According to the invention, the error between the target number of generated bits to be generated in one image 
segment and the number of actually generated bits is distributed to the target quantity of generated bits to be generated 
in each one of other plural image segment groups. 

Also according to the invention, if the number of bits generated at the time of encoding of the sub-set of a certain 
image segment is out of a specified range, the quantizing parameter for encoding the sub-set of a subsequent image 
^egment is controlled to a value different from the preceding quantizing parameters. 

Brief Description of the Drawings 

Fig. 1 is a block diagram of an example of a general MPEG2 encoder. 

Fig. 2 is a schematic diagram showing a picture configuration of MPEG2. 

Fig. 3 is a block diagram showing a constitution of a first embodiment of the invention. 

Fig. 4 is a block diagram showing a constitution of an example of a complexity detector 4 in Fig. 3. 

Fig. 5 is a block diagram showing a constitution of an example of a quantizer control block 6 in Fig. 3. 

Fig. 6 is flowchart showing a calculating method of quantizing parameter by a control unit 16 in Fig. 5. 

Fig. 7 is a graph schematically showing a calculating method of quantizing parameter. 

Fig. 8 is a flowchart explaining a calculating method of quantizing parameter in each picture. 

Fig. 9 is a timing chart schematically explaining increase or decrease in the number of bits generated per GOP at 
advanced complexity of encoding. ' - *- - 

Fig. 10 is a timing chart schematically explaining changes in the number of bits generated per GOP and picture 
quality in the case of an extended duration of information of advanced complexity of encoding. ._ . . _ 

Fig. 1 1 is a timing chart comparing the target number of bits generated per macro block and the number of gener- 
ated bite between a conventional method and the method of the first embodiment of the invention. 

Fig. 12 is a block diagram showing other example of determining complexity of encoding. 

Rg. 1 3 is a block diagram showing a constitution of a second embodiment of the invention. . . „ . . . 

Fig. 1 4 is a block diagram showing a constitution of an example of a quantizer control block 22 in Fig. 1 3. 

Rg. 15 is a flowchart explaining a calculating method of quantizing parameter by a control unit 223 in Fig. 14. 
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Fig. 1 6 and Fig. 1 7 are flowcharts explaining further calculating methods of quantizing parameter by the control unit 

223. 

Fig. 18 is a timing chart explaining the correlation of the complexity of encoding of picture, number of generated 
bits, and picture quality. 

£ Fig. 1 9 is a block diagram showing a constitution of an example of controlling a reaction coefficient T. 
Fig. 20 is a timing chart showing an example of reaction coefficient T. 

Detailed Description of the Preferred Embodiments of the Invention 

io — FiQ. 3 is a block diagram showing a constitution of an example of a moving picture encoding apparatus of the inven- 
tion, in which the moving picture encoding apparatus of the invention comprises a frame converter 1 , a frame delaying 
block 2, an encoding processor 3, a complexity detector 4 for analyzing the input image and calculating the difficulty in 
encoding, a motion detector 5, a quantizer control block 6, and an encoder buffer 7. The encoding processor 3 compre- 
hensively includes the actions of the block converter 102, subtracter 103, DCT 104, quantizer 105, variable length 

75 encoder 106, inverse quantizer 107, IDCT 108, motion compensation block 109, mode discriminator 1 10, and adder 
1 1 4 of the typical moving picture encoding apparatus shown in Fig. 1 . 

Input images are shuffled in the input image encoding sequence in the frame converter 1. The motion detector 5 
calculates the motion vector for each macro block by comparison with each reference picture, as for P picture and B 
picture. This motion vector is sent into the encoding processor 3, and is used for creation of predicted image with motion 

20 compensation. The motion vector is also supplied tothe complexity detector 4. 

Fig. 4 is a block diagram showing a constitution of an example of the complexity detector 4. The complexity detector 
4 comprises a predicted error image generator 8, a DCT 9, a variable length encoder 11, and a generated bit counter 
12. The image data from the frame converter 1 is supplied into the predicted error image generator 8 together with 
motion vector signal. In the predicted error image generator 8, if the input image is an I picture, the image is held as it 

25 is, and in the case of a P picture, by the motion vector from the motion detector 5, a predicted error image is created by 
the difference between the predicted image and the input image. Similarly, in the case of a B picture, a predicted error 
image is created from predicted results on both sides. 

In the DCT 9. successively, the image is transformed in each block, and is quantized in the quantizer 10, and is 
encoded in the variable length encoder 1 1. At this time, the quantizer 10 quantizes always with a constant quantizing 

30 parameter. The value of the quantizing parameter (q_scale) may be an arbitrary value, and herein quantizing is proc- 
essed at q_scale=10 for the sake of convenience. The generated bit counter 12 detects the number of bits of the 
encoded data in every macro block, and multiplies by a fixed value of q_scale, and calculates complexity showing the 
difficulty in encoding in each macro block. The generated bit counter 12 sums up the complexity values of each macro 
block, and supplies the complexity per picture to the quantizer control block. 

35 On the other hand, the input image is delayed by the portion of one picture in the frame delaying block 2, and is 
supplied into the encoding processor 3. The encoding processor 3 encodes same as the moving picture encoding 
apparatus shown in Fig. 1, according to the encoding parameter supplied from the quantizer control block 6, and gen- 
erates a bit stream conforming to the MPEG standard. 

The quantizer control block 6 determines the quantizing parameter q_scale on the basis of the number of gener- 

40 ated bits of the bit stream from the encoding processor 3, the complexity from the complexity detector 4, and the target 
bit rate, and further determines the quantizing width when encoding in the encoding processor 3. 

Fig. 5 shows a block diagram of a constitution of an example of the quantizer control block 6. The quantizer control 
block 6 comprises a generated bit counter 13 for counting the number of bits generated in the bit stream for the portion 
of one GOP generated by the encoding processor 3, a generated bit counter 14 for counting the number of generated 

45 bits for the portion of one picture, a generated bit counter 15 for counting the number of generated bits for the portion 
of one macro block, and a control unit 16. The control unit 16 generates the quantizing parameter q_scale in every 
macro block timing on the basis of the number of generated bits obtained from the generated bit counters 13, 14, 15, 
the target bit rate, maximum transmission rate Dec_R when sending a bit stream to the video decoder, and the com- 
plexity obtained from the complexity detector 4. 

so Fig. 6 is a flowchart showing an example of algorithm for calculating q_scale performed in the control unit 16. 

First, at step SI. it is judged if a sequence end code is detected or not, and if not detected, the process goes to step 
S2. At step S2, when encoding a j-th GOP, the number of generated bits GOP_Bj-1 in the immediately preceding GOP 
is read out from the generated bit counter„13. It is,however. 0 in the first GOP Next, at step S3..the error DIF_Gj 
between the number of generated bits immediately before encoding the j-th GOP and the target number of bits G cal- 

55 culated by supposing that all GOPs generate the same number of bits is calculated in the following formula. 

DIF_Gj=DIF_G H +GOP__B H -G . , . . , . (8) . 

where Dif_G1 = 0. Incidentally, supposing the GOP to be composed of 15 frames of images, one GOP expresses a 
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moving picture for 0.5 second, and hence, in this case, G is 1/2 of the target bit rate, that is, the bit rate transferred per 
second. 

At next step S4, when encoding the j-th GOP, the target number of generated bits R(j) is calculated in the following 
formula. 

5 

R0)=G- I x DIF_Gj (9) 

where T is a constant of 2 or more. This formula means that the error DIF_Gj between the number of bits generated in 
a certain GOP and a preset target number of bits G is not immediately absorbed by the target number of bits assigned 

10 in the next GOP, but is controlled to absorb part of the error DIF_Gj, that is, 1/T only. Since encoding is successively 
done ir; the sequential GOPs, in the adjusting process of target bit in each GOP, the error component is gradually 
absooed in the target number of bits in the subsequent GOPs, so that sudden increase or decrease of the target 
number of bits is alleviated. As for the value of T, meanwhile, an effect may be expected at a numerical value of 2 or 
more, but considering to adjust the target number of bits for several seconds, if one GOP is composed of about 15 

75 frames of images, a proper value is somewhere between 10 and 30. Of course, if adjusting the target number of bits for 
several minutes, a further larger value may be taken. 

Once the target number of generated bits per GOP is determined, then, at step S5, temporary values of target 
number of generated bits per picture TTI, TTP, TTB are calculated in the following formulas. 

^ y , NP - XP' NB • XB * R « ( 10 > 
Al+ KP + ~~ Kb 

XP 

TTP= _ NP . XP NB • X B* ™ < 1 1 > 

AK+ KP + ~~ Kb 



30 



VD 

^ Vl NP-XP NB-X B * "0 < 12 > 

* l+ kp + 



where XI, XP, XB are predicted values of complexity of each picture, and their ratio is important herein. This value may 
be the complexity in the final I, P, B pictures of the immediately preceding GOP obtained from the complexity detector 
35 4, or the fixed value, for example, XI:XP:XB = 160:60:42. Besides, NP, NB are number of P pictures and B pictures in 
the GOP. Values of Kp, Kb are constants for correction determined from the quantizing matrix, and herein Kp=1 .0, 
Kb=1.4. 

In I, P, B pictures, consequently at step S6, CI, CP, CB are set as the reference complexity of reference difficulty in 
encoding. Step S6, however, is skipped when the reference complexity is already read in and the target bit rate is not 
40 changed as a result of judging routine at step S8 and step S9, and the immediately preceding value is directly the set 
value. Setting the quantizing parameter q_scaie at 10, the reference complexity is set at such a value that the number 
of bits generated when encoded by this quantizing parameter may be equal to the temporary values TTI, TTP, TTB of 
the target number of generated bits. 

At next step S9, the average quantizing parameter q__pic is set when encoding so that the reference complexities 
45 CI, CP, CB may be the number of generated bits of TTI, TTP or TTB in the picture at that point. 

At step S10, the target numbers of generated bits Tl, TP, TB of the picture to be encoded are set. Using the com- 
plexity supplied from the complexity detector 4, the number of bits necessary when encoded at the set q_pic is set as 
Tl, TP, TB. \ - . . • .■ * 

At step S1 1 , the quantizing parameter in the picture is controlled, and this step is further described below. 
so Finally at step S12, it is judged if the GOP end code has been detected or not, and if GOP end code is not detected, 
process from step S9 is repeated, and if GOP end code is detected, the process returns to step S1 . ■ , 

The process from determination of temporary target number of generated bits TTI. TTP, TTB (step S5) till determi- 
nation of target number of generated bits Tl, TP, TB (step S10) is described below while referring to the graph in Fig. 7. 
In the graph in Fig. 7, the axis of abscissas denotes the complexity, indicating the difficulty in encoding, and the axis 
55 of ordinates represents the number of generated bits. When quantized at q_scale=1 0. the relation between complexity 
and number of generated bits is expressed by line a. In the first picture, the intersecting point of the temporary target 
number of generated bits TT0 per picture and line (a) is the reference complexity. The complexity in the next picture is 
detected by the complexity detector 4. and supposing the value to be CC0, the target number of generated bits of that 
picture is TO as shown in the diagram. The target number of generated bits per picture is determined depending on the 
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complexity obtained from the complexity detector 4, and the same operation is repeated until one GOP is completed. 

When processing for one GOP is over, the target number of generated bits R(j) assigned to next GOP is determined 
by formula (9). Consequently, depending on the target number of generated bits for newly assigned GOP, the temporary 
target number of generated bits of each picture obtained in formulas (1 0) to (1 2) varies. At this time, supposing the tem- 
porary target number of generated bits to be TT1 , a line (b) passing through the intersection of TT1 and reference com- 
plexity is newly drawn. When the complexity obtained from the complexity detector 4 is CC1 , the target number of bits 
T1 at the intersection of line (b) and CC1 is the target number of bits of the picture at this moment. 

Incidentally the line in Fig. 7 has its upper limit and lower limit values. The upper limit value is determined in the 
following formula, supposing the data remainder in the reproduction side decoder buffer to be VBV_fullness, the initial 
value to be 1 .8M bits as the buffer capacity of standard decoder, and the picture rate to be Pic_R: 

VBV_fullness=VBV_fullness-B_pic+ (13) 

where BjDic is the number of generated bits of the encoded picture detected by the generated bit counter 14, and 
Dec_R is the maximum rate to be entered in the decoder. Or the upper limit is the smallest one of the temporary values 
TTI, TTP t TTB of the target number of generated bits determined in formulas (10) to (12) and VBVJullness. 

On the other hand, the lower limit value of the line of q_scale is determined empirically so that the bit rate may not 
be less than 2 Mbps. 

The detail of the control of q_scale in every macro block by quantizing parameter control in the picture at step S1 1 
in the flowchart in Fig. 6 is described below. 

Fig. 8 is a flowchart for explaining the quantizing parameter control process in the picture. Herein, the value of 
quantizing parameter q_scale in an i-th macro block is MQUANTi, the virtual buffer for rate control is defined, and the 
data remainder before encoding of the i-th macro block is supposed to be di. The initial value of di is determined in 

d0=q_picx— (14) 

where r is the reaction parameter, and herein it is defined as 

r=2 x (target number of generated bits of picture) (15) 

First at step S1 1 1 , the complexity of the entire picture, C_pic, is read. At step S1 1 2, judging if first macro block or 
not, when judged to be first macro block, at step S1 1 3, MQUANTi, the value of quantizing parameter q_scale of the first 
macro block is set at q_pic, di=d0 . 

If not judged to be first macro block as a result at step S1 1 2, the data remainder di before encoding this macro block 
is determined in the following method. 

First, at step S1 1 4, the number of bits generated in the immediately preceding macro block B_mb(i-1 ) is read from 
the generated bit counter 15. At next step S1 15, C_mb(i-1) is determined as the complexity of the immediately preced- 
ing macro block from the complexity detector 4, and the number of bits T_mb (i-1) predicted to be generated in the 
immediately preceding macro block is determined in the following formula. 

T_mb(i-1 )= C -^ 1) x TjDic (1 6) 

where T_pic is T1 in the case of I picture, TP in the case of P picture, or TB in the case of B picture. At step S1 16, di is 
determined in the following formula. 

di=d(i-1)+B_MB(l-1)-T_MB(l-1) (17) 

At step S1 17, MQUANTi is determined in the following formula, and is supplied into the encoding processor 3. 

MQUANTi=di x — (18) 
r 



Such setting of quantizing matrix in every macro block is repeated until the end of the picture according to the judging 
routine at step S1 18. . ■ . ... . ^ . , -. 

Summing them up. by the reference complexity in every picture calculated from the target bit rate, the temporary 
target numbers of generated bits TTI, TTP. TTB are determined, the target number of generated bits is corrected from 
the temporary value in the correlation between the reference complexity and the complexity in the picture at that point 
obtained from the complexity detector 4, and therefore the number of bits may be assigned accordingly if there is a 
scene change or a region of violent action in the picture, or when the complexity increases abruptly. 

Besides, the error from the number of generated bit controlled depending on the complexity in every picture and 
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the target generated bits is adjusted over plural GOPs. and the effect of bit distribution in a GOP immediately after a 
certain GOP is lessened. - 

For example, Fig. 9 schematically shows the changes of number of generated bits in GOP unit in the case of 
momentary increase of complexity in the image of a constant complexity. In Fig. 9(a), for a specific period, an image of 

5 a specific complexity continues, and the complexity suddenly increases at a certain point, and then an image of a spe- 
cific complexity continues again. In the conventional assigning method of number of generated due to sudden change 
in complexity, extremely few bits are assigned. In this embodiment, by contrast, it is understood that changes in the tar- 
get number of generated bits in the GOP right after are small. That is, if the number of generated bits in a certain GOP 
is doubled, only IfT of the error from the target number of generated bits of that GOP has an effect on the target gen- 

io erated bits of the next GOP. Supposing T=20, if one GOP is supposed to compose an image for 0.5 second, almost all 
bit rates are recovered to the target bit rate in 10 seconds. 

Fig. 10 schematically shows the mode of deterioration of picture quality in terms of the number of bits generated in 
every GOP and the quantizing width when an image of constant complexity continues, and is succeeded by an image 
of relatively complicated and constant complexity, then succeeded by an image of the initial complexity. That is, when 

75 the complexity increases, the number of generated bits of GOP increases in order to maintain the picture quality, but it 
is corrected to the number of generated bits for maintaining the bit rate exponentially. At this time, the picture quality will 
not deteriorate suddenly, but it declines continuously for a period of several seconds. When returning to the initial com- 
plexity, the number of bits generated in the immediately succeeding GOP decreases, but it also returns to the optimum 
number of generated bits exponentially. At this time, the picture quality can be continuously recovered for a period of 

20 several seconds from the picture quality difficult in encoding. 

Incidentally, it is also possible to control the picture quality continuously if the target bit rate is changed on the way 
of encoding. That is, if the target bit rate is decreased, the reference set value of complexity decreases also at the same 
rate. Therefore, if encoded at a target rate, the temporary target number of generated bits of next picture also decreases 
nearly in proportion to the target number of generated bits, and therefore the average quantizing parameter of the pic- 

25 ture is nearly the same as in the case when the target number of generated bits is directly maintained, and it changes 
exponentially in the subsequent pictures. 

Moreover, according to the embodiment, since the quantizing width per macro block is also controlled depending 
on the complexity of each macro block in the picture, and therefore the error from the target bit rate is small, and the 
picture can be encoded in an appropriate bit distribution. 

30 Fig. 1 1 schematically compares control of quantizing parameter by the conventional method and control of quan- 
tizing parameter in the embodiment. Fig. 1 1 (a) shows the actual number of generated bits and target number of gen- 
erated bits in the conventional method, and Fig. 1 1 (b) shows the actual number of generated bits and target number 
of generated bits in the method of the invention. 

When the target number of generated bits T in a certain picture is set, according to the conventional method, 

35 assuming the number of bits generated in each macro block to be uniform, the difference from the actual number of 
generated bits was defined as the data remainder of the virtual buffer, and the quantizing parameter was controlled 
accordingly. Therefore, in the image having the peak of complexity in the latter half of the image, the actual bit genera- 
tion amount is small in the first half of the image, and hence the quantizing parameter decreases, so as to be encoded 
at higher picture quality than the initially demanded picture quality. In the latter half of the image, however, the bit gen- 

40 eration amount increases, and finally the number of bits may be larger than the target number of generated bits, or the 
quantizing parameter may increase suddenly due to increase of the buffer remainder, which may lead to deterioration 
of picture quality. 

On the other hand, according to the embodiment, since the target number of generated bits in each macro block is 
set as in formula (16) depending on the complexity, the bit distribution is close to the complexity distribution in the pic- 
45 ture, so that both picture quality and number of generated bits are close to the target. 

In the embodiment, the difference between the target bit rate and the number of generated bits is determined in the 
GOP unit, and the target number of generated bits is corrected, but it may be also done in the picture unit or other unit. 
That is, the macro block, the minimum value of the processing unit of encoding in this embodiment may be defined as 
an image segment, and a set of image segments, such as slice, picture and GOP may be defined as an image segment 
so group, so that the target number of generated bits may be corrected in the unit of an arbitrary image segment group. 

As for setting of reference value of complexity of encoding, not limited to setting by using q_scale=10, other quan- 
tizing parameter may be used, or if the target bit rate is not changed, a fixed value may be set from the beginning. 

Instead of the complexity used for determining the parameters, other index may be used. For example, determining 
the square sum of average and error equivalent to activity of each picture, it may be replaced by the complexity in each 
55 formula. Fig. 1 2 is a block cfiagram for composing this embodiment by using the activity. A predicted error image gener- 
ator 17, same as in the constitution shown in Rg. 4, generates the I picture as it is, and P and B pictures from the pre- 
dicted errors. An operation block 18 determines the square error of each macro block from the predicted error image . 
from the predicted error image generator 17. The total is used as the substitute for the complexity of the entire picture. 

In this embodiment, the quantizer control block 6 is explained as a structure independent of the encoding processor 
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3, but when the encoding apparatus itself is composed of DSP (digital signal processor), it may be used commonly with 
a block for other processing. 

A second embcxJimeht of the invention is described below. Fig. 13 is a block diagram showing a constitution of the 
second embodiment of the invention, in which an input signal is supplied into an encoding processor 20. The encoding 

5 processor 20 encodes each macro block into a signal conforming to MEPG2 according to the value of quantizing width 
q_scaie indicted by a quantizer control block 22, and supplies the encoded signal into an encoder buffer 21 and the 
quantizer control block 22. The encoding processor 20 also supplies the received GOP end timing signal and picture 
end timing signal to the quantizer control block 22. The quantizer control block 22 determines the quantizing width 
q_scale from the target bit rate, reaction coefficient T, and encoded data and timing signal supplied from the encoding 

io processor 20, and supplies the quantizing width q_scale to the encoding processing 20, and controls the number of 
generated bits and picture quality. 

Fig. 14 is a block diagram showing a constitution of an example of the quantizer control block 22 in Fig. 13, and the 
quantizer control block 22 includes a GOP counter 221 for counting the number of bits generated in every GOP, a pic- 
ture counter 222 for counting the number of bits generated in every picture, and a control unit 223 for calculating 

15 q_scale. To the GOP counter 221 and picture counter 222, encoded data is supplied from the encoding processor 20, 
and the number of generated bits is counted. The control unit 223 detects the number of bits generated in every GOP 
or picture whenever* receiving the GOP end timing signal and picture end timing signal, and calculates q_scale from the 
target bit rate (R) and reaction coefficient (T). 

— — Fig. 15 is a flowchart for explaining an example of calculating method of q_scale by the quantizer control block 22. 

20 First, as initial processing, at step S20, the error DIF_Gi between the target number of generated bits per GOP cal- 
culated from the target bit rate R (bps) and the present number of generated bits, reference value q_st of q_scale, and 
virtual buffer occupation capacity VBV_Buffer-fullness of the decoder are set. The minimum number of generated bits 
per picture DO is set at 1 ,000,000 bits/picture rate, and the maximum number of generated bits D1 at 8,000,000 bits/pic- 
ture rate. The set value of DO is determined from the empirical rule that the picture quality drops significantly when the 

25 encoding rate becomes lower than 1 Mbps. On the other hand, the maximum value D1 may be matched with the data 
transmission rate capable of transmitting to the decoder by the reproducing apparatus, or may be set at an arbitrary 
value around, or below it 

At next step S21 , q_scale of the picture to be encoded is calculated and issued according to the following formula. 

30 q_scale=q_st x — - — - (19) 

R- i xDIF_Gi 



35 If, however, larger than the preceding q_scale by 2 or more, it should be the value larger than the preceding q_scale by 
2. As evident from the formula, when DIF_Gi is equivalent to T times the target bit rate R, q_scale diverges infinitely, 
and indeed the upper limit of the error DIF_Gi is limited by the value of reaction coefficient T That is, the reaction coef- 
ficient T is a parameter for determining the allowable range of the error DIF_Gi. 

Also as clear from the formula, all quantizing parameters for encoding a certain picture can be obtained from the 
40 past ones. Q_scale obtained at step S21 is supplied to the encoding processor 20 at step S22. 

At step S23, picture end timing is detected. When picture end timing is detected, at step S24, the number of bits 
generated in picture PIC_CNT is detected. On the basis of the result of detection, at step S25, the occupation capacity 
of virtual buffer is determined in the following formula. 

45 VBV_Buffer_fullness= VBV_BufferJullness-PICJ)NT+R/(picture rate) (20) 

If, however, the right side exceeds the capacity of virtual buffer (fullness_MAX), it is determined as follows. 

VBV_Buffer_fuIlness=fullness_MAX 

At step S26, it is judged if VBV_Buffer_fullness is below the lower limit D2 of the buffer occupation capacity of the 
reproducing side decoder or not, and if below the lower limit D2, a picture skip processing signal is issued at step S27 

^^to avoid underflow. — . • . . 

At step S27, PIC_CNT is judged to be below the lower limit DO or not, and when PIC_CNT is smaller than the lower 
55 limit DO. at step S28, q_scale is decreased so that the number of bits may not be smaller than the lower limit in the sub- 
sequent pictures. Fig. 16 is a flowchart for explaining the operation for setting q_scale to be used in next picture when 
the number of bits generated per picture is below the lower limit DO. Usually. q_scale is decreased by one each, but if _ 
PIC_CNT is significantly smaller than the lower limit, for example, if less than 1/2 of the lower limit DO, the decreasing 
width is varied depending on q_scale at that time. Generally, in the encoding process in a certain picture, the product - 
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of the q-scale value and number of generated bits, that is, complexity is said to be almost constant. That is, when 
q_scale is half, the number of generated bits is doubled. When a relatively large value is assigned for q_scale, to control 
the number of generated bits by varying the value, it is understood that the changing amount must be larger as com- 
pared with the case of a smaller q_scale value. 

Among I, P, B pictures, it is the B picture that has a strong tendency of the number of generated bits being smaller 
than the lower limit DO, and when the quantizing width is controlled from the number of generated bits of the B picture, 
the increase or decrease in the number of generated bits in other pictures is significant. Accordingly, by setting q_scale 
to such an extent that the error from the lower limit DO may be recovered to about half, the changing amount is set to a 
degree so that the number of generated bits may reach the lower limits in several pictures. In the flowchart in Fig. 16, 
first at step S281, it is judged rf PIC.CNT is smaller than V6 of the lower limit DO, and if smaller, q_scale is subtracted 
by the value corresponding to the preceding value. That is, at step S282, if the preceding q_scale exceeds 9, 3 is sub- 
tracted at step S283. At step S284, if the preceding q__scale is judged to be 6 or more to 9 or less, 2 is subtracted at 
step S285. In the case of a further smaller q_scale, it is judged if q_scale is larger than 1 or not at step S286, and if the 
result is TRUE, 1 is subtracted from the preceding q_scale at step S287. 

On the other hand, if PIC_CNT is not smaller than 1/2 of the lower limit DO, at step S289, 1 is subtracted from the 
preceding q_scale, but if q_scale is judged to be 1 or less at step S288, subtraction is not processed. 

Thus, rf the number of bits generated in picture PIC_CNT as the sub-set of image segment is smaller than the spec- 
ified lower limit, the quantizing parameter is subtracted depending on the difference from the lower limit. 

Back to Fig. 15, it is judged whether PIC_CNT is over the upper limit D1 or not at step S29, and if PIC_CNT 
exceeds the upper limit D1 , q_scale is increasedat step 330 to control the generated code amount so as not to exceed 
the upper limit. The process of increasing q_scale is shown in Fig. 1 7. That is, at step S301 , if it is judged that PIC_CNT 
is more than twice of D1 , at step S302, it is judged rf the preceding q_scale is over 9 or not, and if the result is TRUE, 
at step S303, 4 is added to the preceeding q_scale. Or, by the processing of S302, if it is judged that q_scale is smaller 
than 9, at step S304, 2 is added to the preceding q_scale. On the other hand, if PiC_CNT is judged to be smaller than 
twice of the upper limit D1 as a result of judgement at step S301, it is judged at step S305 whether the preceding 
q_scale is smaller than 31 or not. tf the preceding q_scale is smaller than 31 , at step S306, 1 is added to the preceding 
q_scale, and otherwise the same preceding value is set in q_scale value. Thus, the changing amount varies depending 
on the value of the preceding q_scale because a large changing amount is needed if the quantizing width is large. 
Besides, in the case of I picture or scene change, the number of generated bits may temporarily exceeds the upper limit, 
and hence the value of q_scale is changed so that the number of generated bits may settle within the upper limit in sev- 
eral pictures. 

In this way, when the number of bits generated in picture PIC_CNT as the sub-set of image segment is larger than 
the specified upper limit, the quantizing parameter is increased depending on the difference from the specified upper 
limit. 

Again back to Fig. 15, at step S31 , whether GOP end timing or not is judged, and if not GOP end, the control job 
of q_scale for controlling the number of generated bits between lower limit and upper limit is repeated in every picture. 
When receiving GOP end timing, the number of bits generated in GOP GOP_CNT is detected at step S32, and the error 
DIF_Gi from the present number of generated bits is calculated in the following formula at step S33. 

DIF Gi=DIF Gi+GOP CNT- - t r ^ (21) 

~ " (number of GOPs per second) v ' 

On the basis of result of this calculation, back to the beginning process of GOP, the beginning q_scale of next GOP is 
calculated. This series of operation is repeated until encoding is over. 

What is characteristic of the processing mentioned so far is that, as compared with the first embodiment in which 
the complexity of the picture to be encoded must be detected from the complexity detector 4, the change of q_scale, in 
the second embodiment, is determined by comparison between the number of bits generated in the sub-set of the 
image segment encoded immediately before with the upper limit or lower limit, so that the moving picture encoding 
apparatus more suited to real time processing may be specified. 

The picture skip signal issued by the control unit 223 in Fig. 14 is supplied to the encoding processor 20 in order to 
prevent underflow of virtual buffer. The encoding processor 20 receiving the picture skip signal skips encoding for the 
portion of one picture. 

Fig. 18 is a graph schematically showing changes in the number of bits generated in relation to the complexity of 
input image and the picture quality. Fig. 1 8 (a) shows the changes of complexity occurring in a sufficiently short time for 
the reaction coefficient T, and changes of the number of generated bits and picture quality according to the first embod- 
iment. That is, if the complexity of image changes in a relatively short time interval, the number of generated bits is 
assigned depending on the complexity of encoding of image, and it is understood that the picture quality is kept almost 
constant . . : 

On the other hand, as shown in Fig. 18 (b), when encoding of input image is extremely difficult and such signal last- 
ing relatively for a long time is supplied, according to the assigning method of the target number of bits of the first 
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embodiment, the number of bits is generated depending on the complexity of input image, and later the bit generation 
amount decreases exponentially with the reaction coefficient T as parameter. Accordingly, the number of bits becomes 
lower than relatively soon than the number of bits necessary for maintaining a sufficient picture quality and the interval 
to maintain a sufficient picture quality is short By the assigning method of target number of bits of the second embod- 

5 iment, the image interval requiring bit generation over the maximum bit quantity is encoded quickly by a smaller number 
of bits than the maximum bit quantity, and a sufficient picture quality is maintained for a long period. 

Fig. 18 (c) is a graph schematically expressing the relation between the number of generated bits and the picture 
quality in the case of a long duration of image of high complexity followed by a long duration of image of low complexity. 
According to the first embodiment of the invention, right after changing over to an image of low complexity, the number 

10 of generated bits decreases extremely, and then the number of generated bits increases exponentially by the reaction 
coefficient T. For recovery of picture quality, however, the period determined by the reaction coefficient T is required. In 
the second embodiment of the invention, by contrast, the number of generated bits reaches the lower limit quickly, and 
a fair picture quality is maintained. 

In the second embodiment, too, the error between the target bit rate and big generation is calculated in the GOP 

is unit, but instead of the GOP unit, the bit generation error may be also calculated in the unit of several pictures. 

The changing amount of q_scale in every picture can be also set arbitrarily so that the number of bits generated 
per picture may be controlled between the upper limit and lower limit. 

The reaction coefficient T is explained as a fixed value in the first and second embodiments, but it can be also 
changed arbitrarily. That is, the reaction coefficient is set so as to absorb the error occurring in a certain GOP between 

20 the number of generated bits and the target number of generated bits over T GOPs to follow, and therefore a preferred 
reaction coefficient T should be set depending on the actual system. For example, it is preferred to determine the reac- 
tion coefficient T depending on the total number of GOPs to be encoded, or the reaction coefficient may be changed 
nonlinearly depending on the time in the case of a limited reproduction time such as optical disk. 

Fig. 1 9 is a block diagram showing a constitution of an example of variable control of reaction coefficient T depend- 

25 ing on the time, in which a reaction coefficient control block 23 issues a reaction coefficient T by receiving the encoding 
time of the image to be encoded, and the time on the basis of start of encoding of the presently encoded portion. Rg. 
20 is a graph showing the input and output characteristics of the reaction coefficient control block 23. In this embodi- 
ment, as clear from formula (19). when the bit generation error becomes T times the bit rate, the quantizing width is infi- 
nite in numerical formula, and hence the upper limit of bit generation is guaranteed. That is, the reaction coefficient T is 

30 a parameter for determining the upper limit of the error allowable against the target rate in the actual system. On the 
other hand, the larger the reaction coefficient T, it is applicable to the longer interval such as scene change, and a 
desired operation is realized when a larger reaction coefficient is given. For example, the reaction coefficient T is set at 
a large value in the first half of encoding, and is decreased gradually at the end of encoding so as to be a smaller value. 
In this way, the final error of number of generated bits is guaranteed relatively small in the finally set value of T, and in 

35 the intermediate portion of encoding, the reaction coefficient T is set large, and it is applicable to a scene of a relatively 
long time. Fig. 20 is a graph showing the changes of reaction coefficient T Herein, supposing the encoding completion 
time to be C, the intermediate 1/3 period is T=180, and in the first 1/3, T is gradually changed from T=20 to T=180, and 
in the final 1/3, T is gradually changed from T=180 to T=20. In this way, since the reaction coefficient T is large in the 
intermediate portion of encoding, the error in the number of generated bits can be adjusted in a short time in the first 

40 and final portions. This is particularly effective when the beginning and end of the picture to be coded are easily 
encoded scenes such as the title and ending of a movie, and in the body of the movie, since the reaction coefficient T 
can be set targe, the video source of excellent picture quality can be presented. 

In Fig. 20, incidentally, the decrease starting time of reaction coefficient T is the time of 2/3 of the encoding time, 
but when scenes of relatively low complexity in encoding are expected, such as the title and the cast at the ending of a 

45 moving, the reaction coefficient decrease time may be set immediately before end of encoding, so that the reaction 
coefficient can bet set large in almost all range of the movie, so that a high picture quality is realized. 

The value of T is set between 20 and 1 80, but it is not limited. For example, if T is about 5, it is effective to maintain 
the picture quality sufficiently in the scene change in which the picture quality was lowered in conventional encoding of 
fixed rate, and encoding of high picture quality is 'possible by increasing the reaction coefficient as much as possible as 

so the error of number of generated bits may be allowed. ' ' - : . .. 

Furthermore, in the second embodiment, the changing amount of the q_scale value when the bit generation per 
picture has exceeded the upper limit or lower limit is controlled to be within the range of upper limit or lower limit in sev- 
eral frames later, assuming the images of same complexity continue, but it may be also determined by calculation so as 
to set q_scale also to 1/2 when, for example, the lower limit of the number of generated bits becomes 1/2. and the 

55 changing amount is arbitrary as far as the quantizing width is controlled so as to settle the number of bits generated per 
picture between the upper limit and lower limit. 

Thus according to the invention, the target bits generated and the quantizing parameter are set so as to absorb the 
error between the target number of generated bits in image segment group such as GOP unit and the number of gen- 
erated bits gradually to the target number of bits assigned in the plural succeeding image segment groups, and there- 
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fore it is possible to avoid sudden picture quality changes if the images are changed abruptly. 

Also according to the invention, if the number of generated bits in the sub-set of image segment such as the pre- 
ceding picture is outside the range specified by the upper limit and lower limit, the quantizing parameter in the sub-set 
in the next image segment is changed, and therefore it is possible to control the target number of bits generated and 
the quantizing parameter without preliminarily detecting the number of generated bits necessary for encoding of the 
image unit. 

Various changes and modifications of the foregoing embodiments are possible so far as not departing from the 
scope and true spirit of the invention. 

Claims 

1 . A moving picture encoding apparatus for compressing and encoding a picture depending on a target bit rate, com- 
prising a control unit for adjusting the target number of bits depending on the result of dividing the error between 
the target number of bits corresponding to the target bit rate and the number of generated bits required for encoding 
image segment groups just before by a number of 2 or more, and controlling the quantizing parameter for encoding 
the image segment groups depending on the adjusted target bits generated. 

2. A moving picture encoding apparatus of claim 1 , further comprising an encoding processor for encoding the input 
image signal into an image signal conforming to MPEG2, according to the quantizing parameter. 

3. A moving picture encoding apparatus of claim 1 , further comprising complexity detecting means for generating an 
index showing difficulty of encoding depending on the number of bits generated required for encoding by encoding 
an arbitrary segment group, and quantizing width calculating means for calculating the quantizing width depending 
on the target number of generated bits, by setting the reference value of complexity showing the difficulty of encod- 
ing of each image segment group, determining the target number of generated bits when encoding the present 
image segment group calculated from the target bit rate as the reference number of generated bits for encoding the 
image segment group of the reference value of the complexity, and setting the target number of generated bits 
when encoding the present image segment group so that the difference between the target number of generated 
bits of encoding of the present image segment group and the reference number of generated bits may correlate 
with the difference from the reference value of the complexity of the present image segment group detected by the 
complex detecting means. 

4. A moving picture encoding apparatus of claim 1 , wherein the image segment block is a macro block, and the image 
segment group is at least one of slice, picture, and GOP. 

5. A moving picture encoding apparatus of claim 4. wherein the GOP includes an encoded picture in a picture (I pic- 
ture), a forward direction predicted encoded picture (P picture), and both direction predicted encoded picture (B pic- 
ture). 

6. A moving picture encoding apparatus of claim 4, wherein the control unit assigns the target number of generated 
bits in each macro block, from the complexity in each macro block for composing the picture, the complexity over 
the entire picture, and the target number of bits of entire picture. 

7. A moving picture encoding apparatus for controlling a quantizing parameter when compressing a picture, corre- 
sponding to* a target bit rate, comprising a control unit for controlling the quantizing parameter depending on the 
result of dividing the error between the target hit rate and the number of hits generated up to the present image seg- 
ment group by a number of 2 or more. 

8. A moving picture encoding apparatus for controlling a quantizing parameter when compressing a picture, corre- 
sponding to a target bit rate, characterized by controlling the quantizing parameter depending on the result of divid- 
ing the error between the target bit rate and the number of bits generated up to the present image segment group 
by a number of 2 or more, and varying the quantizing parameter when encoding the sub-set of the succeeding 
image segment, if the number of generated bits required for encoding in every sub-set of the image segment divid-. 
ing the image segment group into plural sections is over a specified upper limit or under a specified lower limit 

9. A moving picture encoding apparatus of claim 8, wherein the control unit increases the quantizing parameter if the 
number of generated bits required for encoding the sub-set of the immediately preceding image segment is over 
the specified upper limit 
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10. A moving picture encoding apparatus of claim 8, wherein the control unit decreases the quantizing parameter if the 
number of generated bits required for encoding the sub-set of the immediately preceding image segment is under 
the specified upper limit. 

11. A moving picture encoding apparatus of claim 9, wherein the control unit increases the changing amount corre- 
sponding to the quantizing parameter used for encoding the immediately preceding sub-set if the number of gen- 
erated bits required for encoding the sub-set of the immediately preceding image segment is over the specified 
upper limit. 

12. A moving picture encoding apparatus of claim 10, wherein the control unit decreases the changing amount corre- 
sponding to the quantizing parameter used for encoding the immediately preceding sub-set if the number of gen- 
erated bits required for encoding the sub-set of the immediately preceding image segment is under the specified 
upper limit 

13. A moving picture encoding apparatus of claim 7 or 8, further comprising an encoding processor for creating an 
encoded image conforming to MPEG2 depending on the quantizing parameter. 

14. A moving picture encoding apparatus of claim 8, wherein the image segment group is a GOP, and the sub-set of 
image segment is a picture. 

15. A moving picture encoding apparatus of claim 1 or 7, wherein the number used when dividing the error between 
the number of bits generated required for encoding the immediately preceding image segment group, and the tar- 
get number of generated bits depending on the target bit rate is 20 to 180. 

16. A moving picture encoding apparatus of claim 15. wherein the number used in the division has values of at least 
two kinds or more. 

17. A moving picture encoding apparatus of claim 15 or 16, wherein the number used in the division varies depending 
on the time for encoding. 

18. A moving picture encoding method for compressing and encoding a picture depending on a target bit rate, compris- 
ing a control unit for adjusting the target number of bits depending on the result of dividing the error between the 
target number of bits corresponding to the target hit rate and the number of generated bits required for encoding 
image segment groups just before by a number of 2 or more, and controlling the quantizing parameter for encoding 
the image segment groups depending on the adjusted target bits generated. 

1 9. A moving picture encoding method of claim 1 8 further comprising a step of encoding the input image signal into an 
image signal conforming to MPEG2, according to the quantizing parameter. 

20. A moving picture encoding method of claim 18, further comprising the steps of generating an index showing diffi- 
culty of encoding by complexity detecting means depending on the number of bits generated required for encoding 
by encoding an arbitrary segment group, and calculating the quantizing width by quantizing width calculating 
means depending on the target number of generated bits, by setting the reference value of complexity showing the 
difficulty of encoding of each image segment group, determining the target number of generated bits when encod- 
ing the present image segment group calculated from the target bit rate as the reference number of generated bits 
for encoding the image segment groip of the reference value of the complexity, and setting the target number of 
generated bits when encoding the present image segment group so that the difference between the target number 
of generated bits of encoding of the present image segment group and the reference number of generated bits may 
correlate with the difference from the reference value of the complexity of the present image segment group 
detected by the complex detecting means. 

21 . A moving picture encoding method of claim 18, wherein the image segment block is a macro block, and the image 
segment group is at least one of slice, picture, and GOP. . : . . . , : , 

22. A moving picture encoding method of claim 21, wherein the GOP includes an encoded picture in a picture (I pic- 
ture), a forward direction predicted encoded picture (P picture), and both direction predicted encoded picture (B pic- 
ture). „ . 

23. A moving picture encoding method of claim 21, characterized by assigning the target number of generated bits in 
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each macro block, from the complexity in each macro block for composing the picture, the complexity over the 
entire picture, and the target number of bits of entire picture. 

24. A moving picture encoding method for controlling a quantizing parameter when compressing a picture, correspond- 
ing to a target bit rate, characterized by controlling the quantizing parameter depending on the result of dividing the 
error between the target bit rate and the number of bits generated up to the present image segment group by a 
number of 2 or more. 

25. A moving picture encoding method for controlling a quantizing parameter when compressing a picture, correspond- 
ing to a target bit rate, characterized by controlling the quantizing parameter depending on the result of dividing the 
error between the target bit rate and the number of bits generated up to the present image segment group by a 
number of 2 or more, and varying the quantizing parameter when encoding the sub-set of the succeeding image 
segment, if the number of generated bits required for encoding in every sub-set of the image segment dividing the 
image segment group into plural sections is over a specified upper limit or under a specified lower limit. 

26. A moving picture encoding method of claim 25, characterized by increasing the quantizing parameter if the number 
of generated bits required for encoding the sub-set of the immediately preceding image segment is over the spec- 
ified upper limit. 

27. A moving picture encoding method of claim 25, characterized by decreasing the quantizing parameter if the number 
of generated bits required for encoding the sub-set of the immediately preceding image segment is under the spec- 
ified upper limit. 

28. A moving picture encoding method of claim 26, characterized by increasing the changing amount corresponding to 
the quantizing parameter used for encoding the immediately preceding sub-set if the number of generated bits 
required for encoding the sub-set of the immediately preceding image segment is over the specified upper limit. 

29. A moving picture encoding method of claim 27. characterized by decreasing the changing amount corresponding 
to the quantizing parameter used for encoding the immediately preceding sub-set if the number of generated hits 
required for encoding the sub-set of the immediately preceding image segment is under the specified upper limit. 

30. A moving picture encoding method of claim 24, characterized by creating an encoded image conforming to MPEG2 
depending on the quantizing parameter. 

31- A moving picture encoding method of claim 24, wherein the image segment group is a GOP, and the sub-set of 
image segment is a picture. 

32. A moving picture encoding method of claim 18 or 24, wherein the number used in the division is 20 to 180. 

33. A moving picture encoding method of claim 32, wherein the number used in the division has values of at least two 
kinds or more. 

34. A moving picture encoding method of claim 32 or 33, wherein the number used in the division varies depending on 
the time for encoding. 

35. A moving picture encoding apparatus for compressing and encoding a picture depending on a target bit rate, com- 
prising a control unit for setting the quantizing parameter depending on the error between the target number of hits 
corresponding to the target bit rate and the number of generated bits required for encoding the immediately pre- 
ceding image segment group, the reaction coefficient T for determining the allowable range of the error; and the 
quantizing parameter when encoding the immediately preceding image segment group. 

36. A moving picture encoding apparatus of claim 35, wherein the control unit sets the quantizing parameter in the 
maximum value when the error is near the allowable range of the error determined by the reaction coefficient T. 

37. A moving picture encoding apparatus of claim 35. wherein the control unit sets the quantizing parameter depending 
on the ratio of the difference of subtracting the result of dividing the error by the reaction coefficient T from the target 
bit rate, to the target bit rate. 

38. A moving picture encoding method for compressing and encoding a picture depending on a target bit rate, charac- - 
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terized by setting the quantizing parameter depending on the error between the target number of bits correspond- 
ing to the target bit rate and the number of generated bits required for encoding the immediately preceding image 
segment group, the reaction coefficient T for determining the allowable range of the error, and the quantizing 
parameter when encoding the immediately preceding image segment group. 

39. A moving picture encoding method of claim 38, characterized by setting the quantizing parameter in the maximum 
value when the error is near the allowable range of the error determined by the reaction coefficient T. 

40. A moving picture encoding method of claim 38, characterized by setting the quantizing parameter depending on 
the ratio of the difference of subtracting the result of dividing the error by the reaction coefficient T from the target 
bit rate, to the target bit rate. 
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